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A density matrix p{t) yields probabilistic information about the outcome of measurements on 
a quantum system. We introduce here the past quantum state, which, at time T, accounts for 
the state of a quantum system at earlier times t < T. The past quantum state S,{t) is composed 
of two objects, p{t) and E{t), conditioned on the dynamics and the probing of the system until t 
and in the time interval [t,T], respectively. The past quantum state is characterized by its ability 
to make better predictions for the unknown outcome of projective and weak value measurements 
at t than the conventional quantum state at that time. On the one hand, our formalism shows 
how smoothing procedures for estimation of past classical signals by a quantum probe [M. Tsang, 
Phys. Rev. Lett. 102, 250403, (2009)] apply also to describe the past state of the quantum sys- 
tem itself. On the other hand, it generalizes theories of pre- and post-selected quantum states 
[Y. Aharonov and L. Vaidman, J. Phys. A: Math. Gen. 24, 2315 (1991)] to systems subject to any 
quantum measurement scenario, any coherent evolution, and any Markovian dissipation processes. 

PACS numbers; 03.65.-w, 03.65.Ta, 03.65.Ca 



Quantuni systems are described by wave functions or 
density matrices, which yield probabilistic predictions for 
the outcome of measurements performed on the systems. 
Following upon the rules laid out with the foundations of 
quantum theory in the 1920'es, the description of mea- 
surements on a so-called open quantum system has in the 
last few decades evolved into a well-established stochastic 
theory According to this theory, the density matrix 
p{t) evolves with time in a manner governed, on the one 
hand, by the system Hamiltonian and damping terms 
and, on the other hand, by the back action associated 
with the random outcome of measurements performed 
on the system or its environment. In this article, we 
introduce a new element in the quantum description of 
probed quantum systems: the past quantum state. While 
the density matrix p{t) yields predictions about the out- 
come of the measurement of any observable at time t 
conditioned on previous measurements, the past quan- 
tum state yields better predictions for the same measure- 
ment by being conditioned on all measurements carried 
out until the present time. The past quantum state is the 
state that we, based on what we know now, assign to a 
quantum system in the past. It is thus similar to the com- 
pletely natural assignment of probabilities to past values 
of classical random quantities, e.g., for a Brownian par- 
ticle detected at position x to have been at the position 
y at given earlier times. Here, we provide a generaliza- 
tion of the assignment of probabilities to past classical 
stochastic processes to the quantum case. Along with 
the definition and derivation of a past quantum state 
formalism, we shall answer the pressing questions: What 
does it mean to make predictions about the past? What 
are the new results and applications of a theory of past 
quantum states? 

Consider an open quantum system subject to our con- 
tinuous probing as illustrated in Fig. [T] We assume the 



initial quantum state po, at time i = 0, and we probe 
the system until time T such that, conditioned on the 
measurement outcomes, the density matrix p{t) is given 
at any time t G [0,T]. Specifically, if a different observer 
performs a measurement on the system at the intermedi- 
ate time t, the density matrix p(t) provides the probabil- 
ity distribution of the possible measurement outcomes. 
Probing of the system after time t yields results that 
further refine our knowledge about the system at t and, 
indeed, there exists an effect matrix, E(t), assuming the 
same Hilbert space dimension as p{t), which depends on 
the dynamics and on the information acquired later than 
t until the present time T such that the pair of matrices, 



E{t) = (pit), E(t)), 



(1) 



together enable better predictions than p{t) alone for the 
outcome of measurements carried out at time t. To dis- 
cuss in a meaningful way what is meant by predicting a 
past measurement, we consider the setup shown in Fig.[T] 
Through an appropriately chosen interaction the physi- 
cal property of interest is extracted at time t via coupling 
to another quantum system, an ancillary "meter" . This 
meter is stored "in a safe", or it may be immediately 
measured and the result stored for later inspection. We 
show that provides better predictions than p(t) of 
what will eventually be observed when the safe is opened. 
This qualifies S(t) rather than pit) to be associated to 
the past quantum state of the system. 

The text book description of projective quantum mea- 
surements of a Hermitian operator is a specific case of 
general measurements associated with the action of dif- 
ferent operators Clm that fulfill Tim^lnP'm — I, where / 
is the identity and m is an index referring to the possible 
measurement outcomes For such a generalized mea- 
surement a suitable generalization of Born's rule provides 
the probability at time t for observing the outcome m: 
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FIG. 1. Modeling a past measurement: A quantum system "s" is monitored during [0,T] and possibly subject to coherent 
evolution by the Hamiltonian H and coupling to a heat bath. At time t a physical property of s is mapped to a meter "m" 
using an interaction V. This meter, or the outcome of a measurement performed on the meter, is stored in a safe immediately 
after the interaction at time t. The matrices p and E, depending on the measurement signal before and after t, respectively, 
constitute the past quantum state, which predicts better the measurement outcome than p alone when the safe is opened at 
time r. 



p{m) = Ti{Clmp{t)fll^) /Ti{p{t)). In the Supplementary 
Information Q we prove that after further probing of the 
system until time T, the probability that the outcome is 
m depends on S(t), i.e., on both p{t) and E{t): 



Pp{m) = 



(2) 



This formula is general and covers all possible measure- 
ment scenarios and any Markovian dynamical evolution, 
observed or non-observed, of our quantum system. As ex- 
emplified below and derived formally in the Supplemen- 
tary Information Q, E(t) can be calculated backward in 
time following an adjoint equation very similar to the for- 
ward evolution of p{t). In absence of probing, E retains 
its value E' = / for all times, and Eq. ([2]) reduces to the 
conventional expression since only our observations can 
further the knowledge of the state. 

In the special case of a projective measurement of an 
observable A, Eq. ([2]) applies with tlm = Hm denoting 
orthogonal projection operators on the eigenstates of A. 
Past mean values, variances, and higher moments of A 
then follow in the usual manner from pp(rn). It is inter- 
esting to note that variances of past measurement out- 
comes will not necessarily obey Heisenberg's uncertainty 
relations for non-commuting operators A and B. This, 
however, is not in violation of quantum mechanics since 
our probabilistic statements concern only the value of 
the observable actually measured, i.e., either A or B. 
In Ref. [1], a clever guessing game is suggested, where a 
person is given a spin-1/2 particle, and is free to measure 
either the x, y or z component of the spin, and subse- 
quently return the particle. By preparing the initial state 
and measuring the final state, it is possible to announce 
the outcome of any of these measurements without un- 
certainty. The past quantum state also permits a full 
analysis of such games. 

Our general formalism permits also an analysis of so- 
called weak value measurements In this case the 



strength of the interaction between a system observable 
A and the meter can be parametrized by a small num- 
ber e <^ 1, such that the disturbance resulting from 
the measurement is proportional to and thus may 
be neglected. Nonetheless, averaged over sufficiently 
many experimental realizations the meter read-out will 
reveal the mean value of the system observable A by 
the formula: (A)^ = Tr(App) where we have defined 
the past density matrix pp = pE/TT{pE) 3]. Here p 
and E are exactly the constituents of the past quantum 
state dD) and we thus provide a generalization of existing 
weak value expressions: {A)„ = Re{{(p\ A / {(p\ ip)} or 
(A)w = Re{TT{Ap^Ejn)/T^r{piEm)}, which apply, respec- 
tively, for a system initially prepared in a pure state {tp) 
or mixed state pi and subsequently projected into the fi- 
nal state \ip) or detected by a generalized measurement 
operator Em 0, [1] • In these two examples pp takes the 
form lip) {ip\ / {ip\')p) or piEm/THfiEm), which has re- 
cently led to the recognition of these expressions as pre- 
and post-selected "connection states" 7] . In our general 
theory, the quantum state may at any time in the past be 
viewed as a pre-selection p by earlier measurement and 
a post-selection E by the later ones, with unitary evo- 
lution, dissipation processes, and direct measurement on 
the system also accounted for. We note that pp is not 
described by a single evolution equation, but p and E 
must be calculated separately. 



To illustrate the past state formalism and some of its 
results for a physical problem, let us turn to an example 
with a quantum system subject to coherent evolution, 
dissipation, and continuous homodyne-like monitoring. 
In such problems the usual quantum state p{t) is con- 
ditioned on the detection record until t G [0, T] and it 
formally obeys the corresponding stochastic master equa- 
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FIG. 2. Forward and past expectation values of a continu- 
ously monitored spin-1/2 particle: In panels (a) and (b) the 
curves show: {az) [solid black], (ax) [solid gray], Re{((Tz)p} 
[dashed black], and Re{(o-a;)p} [dashed gray]. In panel (b) 
an observer has performed a projective measurement of 
on the system at time to without revealing the result. This 
leads to (a^) resetting to zero and the spectral boundary 
— 1 < Re{(iJz)p} < 1 automatically enforced. Panels (c) and 
(d) show the probability distribution for this projective mea- 
surement revealing spin-up based on p(to) and S,{to), respec- 
tively, using 10,000 simulations. 



tion 

dpt 



i[H, pt]dt + ^/r]{cpt + ptC^)dYt 



(3) 



where dpt = pt+dt — Pt, H is the interaction Hamilto- 
nian, c is the measurement observable, L,„ are Lindblad 
operators describing the dissipative coupling to the envi- 
ronment (including c as one of the Lm-terms), ij is the 
detector efficiency, and dYt is the measurement record. 
The effect matrix E solves a corresponding adjoint equa- 
tion with final condition E — I at T [31 : 



dEt =i[H, Et]dt + ^{c^Et + Etc)dYt-dt 
+ Y,iLlE,Lm ^ 



-{LlL„,,Et})dt, 



(4) 



where dt is positive and dEt = Et-dt — Et, propagat- 
ing backward from T to t using the same measurement 
record dYt as in Eq. (|3]). We note that these equations 
are not trace preserving but can easily be adapted as such 
if required, e.g. for numerical evaluation. 

For concreteness, we consider now a quantum two-level 
system subject to coherent driving with Rabi frequency x 
according to the Hamiltonian H — ^{x(J++X*'^-) ^'^d to 
continuous probing of cr^ through the measurement op- 
erator c = \fkdz. Here are Pauli spin operators and 
fc is the measurement strength. Such measurement could 
be implemented by, e.g., polarization rotation of a radi- 
ation field coupled to the spin-1/2 particle [Sj. We have 
performed simulations with = 1, a pure initial state 
Po = It) (t|j and an imaginary x such that the coherent 
driving rotates the spin around the y-axis. In Fig. [2l 
the expectation value of the Pauli operators, ct^ and a,j,^ 
for the quantum system are compared using the usual 
forward state p(€) and the past quantum state 

The analysis in Fig. [2lja) applies to the case where the 
system has not been disturbed by further measurements 
by other observers. This implies that the past density 
matrix /Op(t) may be used to yield predictions for the 
outcome of weak value measurements of any system ob- 
servable. We stress that despite its possible values be- 
yond the interval [—1,1], {crj{t))p — Tr(i7jyOp(t)), rather 
than {aj{t)) = TT{ajp{t)), represents the correct estimate 
of the disturbance of the meter system. For a spin-1/2 
meter system, the real and imaginary parts of {^jit))p 
correspond to mean rotation angles of the spin around 
different axes [lo| . 

Fig. mb) exemplifies the case where an observer has 
performed a projective measurement of at time io 
without revealing the result, and Eq. ([2]) enables a past 
prediction (o'z(to))p of this outcome using S(to)- For all 
other times t € [0, T] the projective measurement must 
be taken into account in the evolution of p and E. To 
account for the decoherence by the measurement at to, 
we evolve the density matrix, p{to+) = Pupp{to-)Pup + 
Pdownp{to-)Pdown by the projection operators. Pup = 
It) (tl and Pdown — It) (il- Similarly, to obtain the value 
of the effect matrix E prior to Iq, we have to apply the 
operation E{ta^) = PupE{to+)Pup + PdownE{to+) Pdown- 
It is particularly interesting to compare the predictions of 
the un-revealed measurement outcome using the conven- 
tional and the past quantum state formalism. For predic- 
tions associated with projective measurements, {d'z{tQ))p 
is real and it remains within its spectral boundaries as it 
should to yield agreement with experiments. The result, 
however, differs from the prediction by the conventional 
density matrix, and we quantify this difference by the 
distribution of probabilities for the two-level spin direc- 
tion to be registered as up or down. These distributions 
are shown for the conventional quantum state in Fig.[5Jc) 
and for the past quantum state in Fig. [^d) . By assuming 



that the most likely measurement result is the one oc- 
curring, we guess the outcome correctly with 88% proba- 
bility by the conventional quantum state p{to), while the 
past quantum state S(io) yields the correct measurement 
outcome with 94% probability. 

We note that if p{t) predicted a measurement outcome 
with certainty at time t, our later probing will never lead 
to disagreement with this prediction: If the system was in 
the mth eigen state \am} of an observable A, i.e. A \am} — 
dm \0"m), at time t, then p{t) = \am) (am| = Hm and the 
past probability for measuring the nth eigen state then 
becomes: Pp{n) = 6n,m according to Eq. ^ and the 
orthogonality relation Ilmlln = IVrn5n.,m- 

While the past quantum state enables a sharper predic- 
tion for the projective measurement shown in Fig.[5Jc,d), 
we note that the weak value {(Tz)p is actually smoother 
than the forward estimate {dz) in Fig.[2][a,b). In the Sup- 
plementary Information we show that while (ct^) varies 
with noisy increments oc dYt oc ^fdt due to Eq. (jS]), the 
changes in ((Tz)p at time t are formally independent of 
dYt and vary smoothly according to the integrated noise 
via p{t) and E{t). 

To exemplify an estimation process with mixed coher- 
ent and incoherent degrees of freedom, we consider in 
Fig. [3] a coherently driven, spontaneously decaying two- 
level atom which can jump incoherently between two 
sites, a and b. In Fig. [3Ja) the position of the atom 
(as used in the simulations but in experimental realiza- 
tions hidden from us) is shown along with the instants 
of detection of photons emitted from the two-level atom. 
Owing to different site environments, the coherent atom- 
dynamics is determined by different parameter values at 
each site. We can use the forward and past quantum 
states, based on the photo-detection record only, to esti- 



mate the location of the atom as shown in Fig. [3 
Fig.[31[c), respectively. As demonstrated in Refs 



b) and 



a similar formalism enables the estimation of unknown 
classical perturbations, applied to a probed quantum sys- 
tem. These works generalize the so-called smoothing 
procedure applied in the classical probability theory of 
Hidden Markov Models (HMM) [l^ to hybrid quantum 
classical systems. Such hybrid systems may, indeed, be 
embedded in a full quantum model, and we comment fur- 
ther on the formal similarities between our past quantum 
state and the smoothing procedure in classical HMM in 
the Supplementary . The past quantum state estimate 
is both much less noisy and much more decisive, enabling 
a more accurate state estimation and, e.g., a better esti- 
mate of the a-h jump rate. In addition to estimating such 
classical properties our formalism provides also a better 
estimation of the quantum system itself and we are cur- 
rently investigating the application of our theory to the 
state of a photon field in a cavity 16[ and to the state of 
a superconducting qubit [l7l - [l9| . 

The past quantum state depends on events oc- 
curring in the future beyond the time t. While "spooky 
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FIG. 3. Forward and past estimate of discrete position jumps 
of a driven two- level atom: In panel (a), the actual random 
position jumps of the atom are shown (red line) along with 
the photon detection times (vertical black). At position a (b), 
the atoms have a low (high) average emission rate. Panel (b) 
shows the probability for finding the atom at site b calculated 
using the forward density matrix, while panel (c) employs the 
past quantum state using the same data. Panel (c) is clearly 
more decisive and in much better agreement with the true 
state (red line in panel (a)). 



action from the future" via pos t-selection has stimulated 
fascinating scientific debate [20j , the predictions we make 
can be interpreted as correlations between system observ- 
ables at the past time t and a probing signal acquired 
in the, also past, interval [0,T]. This distinction has 
also been made clear in the formal work on pre- and 
post-selected states [2l|, |22| . While the concept of a past 



quantum state is also central in these publications, our 
analysis aims less on the foundations of quantum the- 
ory and more on the general and explicit description of 
continuously monitored open quantum systems that are 
commonplace in laboratories today. Our theory applies 
to experiments on superconducting devices 
semiconductor quantum dots 
mond 25, 2^; nuclear sr 
atoms and molecules |28|-|3C 

nanomechanical devices [33[. These systems, indeed, may 
be used for fundamental tests [l^ 23, 25, [2^ 31 1, but 



24| 



13-1 



NV-centers in dia- 
jins in silicon [271; tra pped ions. 



photons 




and 
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they also hold the potential for application in precision 
probing [s^] and quantum information science Q, and 
we hope our theory will stimulate further development of 
both technical and foundational aspects of the theory of 
open quantum systems. 

This work was supported by the Villum Foundation. 
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FIG. 1. Graphical illustration of the system dynamics considered in this note. Our open quantum 
system (top line) and a meter (bottom line) interact as described by the unitary operator U. The 
system is probed by subsequent measurements with outcomes yi,...yN, and later, the meter is 
subject to a projective measurement in some basis {|m)}. 

In this supplementary note we show that with our definition of the past quantum state we 
obtain identical results for past measurement outcomes as predicted by the ordinary quantum 
formalism, when this is applied to deferred measurements on a combined system-meter set- 
up [1]. Instead of an expression for determining past measurement outcomes propagating 
forward in time and including the meter system, we derive a backward propagating effect 
matrix E for the system only. We provide the specific stochastic differential equations for 
diffusion and jump type probing of the system (corresponding to homodyne detection and 
photon counting schemes). These equations can be chosen linear and non-trace preserving 
or non-linear and trace-preserving as the usual quantum filtering equations [2]. Finally, we 
demonstrate that our past quantum state generalizes the so-called smoothed state in classical 
hidden Markov models to the quantum case: The conditional density matrix p{t) is a natural 
generalization of the a-state conditional probability, and the backward propagating effect 
matrix E is the quantum generalization of the backward propagating /3-state in hidden 
Markov models [3]. 

A. DEFERRED MEASUREMENTS AND THE PAST QUANTUM STATE 

Imagine an observer using a meter to perform any measurement on our system which is 
initially prepared in a state which is represented by the density matrix pq. The observer 
correlates the meter and our system by a unitary interaction, U, between them. After this 
unitary interaction the system evolves independently of the meter and during this evolution, 
we measure our system a number of times N as illustrated in Fig. 1. By taking a suitable 
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limit with — )■ oo a description of continuous-time observation can be obtained. The 
observer who now has the meter in her possession can choose to perform a measurement of 
her choice at any later time. Our goal is to predict the result of such a measurement. 

We have access to the results of the measurements, where each measurement is in 
the most general case described by a set of measurement effect operators My for each 
measurement outcome y in the set of possible measurement results Y . Using this for- 
malism the effect of the measurement result y is to update a density matrix p according 
to p 1-^ MypM^I Ti{M^Myp). The resulting density matrix, which we denote p\y, is condi- 
tioned upon the measurement result y. The probability of obtaining the result y is given by 



any y G F is unity. If the observation is made with less than 100% readout efficiency the 
resulting conditioned density matrix can be written as a sum 



where Mk\y are operators describing different possible effects which are all associated with 
the measurement result y. The number of terms, can depend on y. 

Equation (Al) captures the effect of most types of dynamics of open quantum systems, 
including unitary evolution, dissipation effects described by a master equation on Lindblad 
form, and measurements. A density matrix subject to unitary evolution with unitary oper- 
ator U is thus updated according to p i— )■ MpM'^ . Where only the single unitary operator 
M is needed clearly satisfies M'^M = I. 

A projective measurement is described by a set of projectors where a are eigenvalues 
of the observable A being measured, and this case is also included by the identification 
Ma = n^. The effect on the system density matrix by a projective measurement is then 
simply the usual projection postulate p ^-—^ Ilapria/ Tr(nap). If we know that a projection 
measurement is performed, but the result of the measurement is hidden from us, the density 
matrix is updated according to p i — > "^^YlapHa- In this final example, all off-diagonal 
density matrix elements in the eigen basis of A are zeroed, and the unobserved measurement 
operation is therefore equivalent to a decoherence process. 

If a number of measurements are performed in sequence the density matrix p is updated 





Ef=l M,\ypM, 



k\y 



(Al) 
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repeatedly by the formula Eq. (Al). In the limit of continuous-time measurements we can 
also describe the conditional time-evolution of the system density matrix. Consider for 
example a quantum system subject to homodyne detection. In this case the effect of a 
detection in a small interval of time dt is given by the operators 

MdYt = i2ndty^^^ exp{-dYt^ /Adt){i - iHdt - c^c/2dt + cdYt), (A2) 

where H is the system Hamiltonian and c is the system operator coupling to the real homo- 
dyne output signal dYt. [2, 4] The probability for observing dVt in this infinitesimal interval 
of time is a normal distribution with mean value TT{{c+c^)p)dt and variance dt. By applying 
the update formula Eq. (Al) with these operators we get Eq. (3) with rj = 1 and only one 
Lindblad operator Li = c. By including unobserved output channels for Lindblad operator 
Li, i > 1 and including limited detector efficiency rj < 1, Eq. (3) turns out to be a special 
case of Eq. (Al). 

Let us return to our main line of inquiry. The meter is assumed to be initialized in a 
pure state \i) {i\ when the observer applies the unitary interaction, acting on the combined 
system-meter state po®\i) The resulting state is U{po® \i) (^l)f^^- By inserting complete 
bases of the meter Im = XlmeA/ 1"^) ("^1 obtain 

P= ^ ^mPo^L' {m'\, (A3) 

where we have defined the system operators flm = (/ ® (m|)f/(/ ® The operators Qm, 
defined this way, satisfy the requirement for measurement effect operators, J2m€M ^In^m = 
I, and with the chosen form for the operators Clm, we use the coupling to the meter to 
formally interrogate the properties of the open quantum system at the intermediate time 
t. We imagine that the open system dynamics proceeds, including the observations on 
the system continue with measurements result y & Y, which cause the continued system 
dynamics described by Eq. (Al). In the general formula Eq. (Al) we can include unitary 
dynamics, dissipation channels and partially efficient measurements. As noted above, all 
these effects can be included by a suitable choice of the operators Mk\y 

Since the subsequent dynamics only concern the system, the operators Mk\y only act 
on the system degrees of freedom. The normalized system-meter state conditioned on one 
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measurement with the result y is 

Ef=l Em.m'GM Mk\y^mpAMly ® \m) {m'\ 

p\y = Y< — ' — ^T~T^ — • 

We can calculate the expectation value of any meter-observable X in the state ply by the 
usual formalism, 

- - EfiE ,^MT^^iMk\v^niPo^LMl )(m'\X\rn) 

A projective measurement on the meter, which is now conditional on the system mea- 
surement result y, and yields the result m with the probability 

Pi^y) . ^l.W.,AMl,) ^^^^ 

where we have calculated the conditional expectation value of the meter projection operator 
X = |m) (m| to obtain the conditional probability P{m\y). Note that we can rewrite the 
numerator in (A6) as 



K 



A;=l 



K 



k\y 



k=l 



where we have defined the effect matrix E = Ea^i ^k\y^^k\y, and we obtain 

P{m\y) = ^'^^-P^^lnE) (^g^ 

This is the probability for the outcomes, stored "in the safe" as described in the main text. 
I.e., P(m||/) is the retrodicted probability for the result m of a general measurement on 
the system with the corresponding measurement operator {Qm}- It notably differs from the 
usual formula P(m) = Ti (fll^ClmPo), as it is possible to predict the outcome of measurements 
on the meter better than before we had access to the later measurement result y. 

In the same way as the usual time dependent quantum state of a system, represented by 
a wave function iplt) or a density matrix p{t), yields probabilities for general measurements 
on the system, we have now identified a mathematical structure, composed of po and E, 
which provide the probabilities for past measurements on a quantum system. We thus call 
the pair of matrices H = (po, E) the past quantum state. 



Tr(M„poMt^E), (AT) 



If the system has evolved until time t, and multiple measurements have been performed 
before the meter interacts with our system, S(t) = {p{t), E{t)), where p{t) is the usual 
open system density matrix found by a stochastic equation of evolution conditioned on the 
measurements before time t. If multiple measurements are performed in sequence after 
the meter has interacted with our system at time t, the effect matrix E(t) depends on all 
measurement results after the coupling to the meter. In the following sections, we will derive 
efficient equations of evolution to determine E for both general probing scenarios and for a 
few special cases. 



1. Dynamical equations for the effect matrix 



Assume that the measurements up to time t has been taken into account in the forward 
state po then the generalization of Eq. (A5) when two subsequent measurements with result 
Hi and y2 are performed is 



nX\yi,y2] 



E^m,.,eMElM=i^' U^;^.l..^fcil.i^-Po^^!n'<|,,^l|,J {m'\X\m) 



S/2 



(A9) 



By using the cyclic property of the trace, the numerator can be written as 



K 



J2 T^'[^mP0^l'Y.\K 

m,m'eM 



yi 



ki=l 



K 



U2 = l 



Mk,\y, } {m'\X\m), (AlO) 



In this case, the effect matrix E is therefore given by 



K 



yi 



ki=l 



K 



Lfc2 = l 



Ml 



fcllj/l) 



(All) 



where E now depends explicitly on the two future measurement results yi and y2- 

From this we see that the update formula for E, as a counterpart to Eq. (Al), is given 
by the adjoint update 

K 

k=l 

where E equals the identity / at the final time of measurements T, and is propagated 
recursively backward as indicated in the case of two measurements. 



K 



K 



y2. 



k2=l 



yi . 



\yi 



fci=i 



K 



/ J k2\y2 ' 



k2\y2 



.fc2 = l 



M, 



ki\yi- 



(A13) 
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The propagation is readily generalized to the case of measurements, 

EN = i^ En^, ^...^ E,. (A14) 

A hermitian operator E remains hermitian since the right hand side of Eq. (A12) is 
invariant under hermitian conjugation. Indeed, E has a separate physical interpretation as 
the positive semi-definite operator which given the state po yields the probability for the 
sequence of future measurement results, . . . VnIpq) = Tr(_E'po)- 

2. The past density matrix 

Our definition of the past quantum state necessitates the use of two matrices from which 
probabilities can be generally determined via (A8). That expression may, however, be 
simplified in the special, but interesting, case where the system and meter are coupled very 
weakly. 

We choose a two-dimensional quantum system as our meter, represented as a spin-1/2- 
particle, interacting briefly with our system by an interaction V = iglAa'^ — A'^a) where a 
is the spin lowering operator and A is any, not necessarily hermitian, system operator. The 
meter is initially prepared in the spin-down state and we allow the interaction to be 
active for a duration r such that U = exp(e(y4(j^ — A'^a)) where e = rg. In the (weak) limit 
e < 1 

U = I + e{Aa^ - A^a) - - l^AA^a^a + A^Aaa^j + O(e^). (A15) 

If the meter is initialized in spin down in the 2;-direction \D then the measurement effect 
operators in the z-basis are given by = {I ^ {fi\)U{i ® ||)) , p =i, t; 

ni = i-'^A^A + 0{e') (A16) 
Q^ = eA + 0{e^). (A17) 

The effect of the measurement on the system state po when the result is not revealed is 

Po^Vl^Po^l + Q^PoQ\ = po + 0{e^). (A18) 

The measurement associated with the subsequent readout of the meter is weak in the sense 
that it leaves the system undisturbed to first order in e. This type of measurement can 
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thus be performed unnoticed, and our formalism should enable prediction of its outcome in 
a seemingly "counter-factual" manner ("If A had been measured, the outcome would have 
been ... "). The nature of the weak measurement allows an unknown agent to perform 
measurements without our knowledge and hide the result from us. At any later time, this 
person can inform us of the result, and we need the present theory to most accurately predict 
the outcome of this result. This ability comes with a cost, as to the interpretation of the 
weak measurement result, which we will return to shortly. 

An arbitrary projective measurement of the meter is described by linear combinations 
of Cl^ and Cl^. For measurements in the and a^-bases we can express the conditional 
expectation of = {d' + o"^) and ay = i{a — a^) by the real and imaginary parts of the 
expectation value of the step down operator a, respectively. 

The expectation value of the meter operator a is 

^Hy] = — ^ TZ r-^- (A19) 

In this formula the denominator is independent of A. This is due to the weak nature of the 
measurement, and it implies, that the expectation value is linear in the system operator A. 
Since the meter couples to the system observable A, it is natural to consider the weak value, 

(^)w = - E[a\y] = -— -^^ — ^. (A20 

We observe that to retrieve the weak value, i.e., the average outcome of a weak mea- 
surement, the information in the past quantum state S = (po, E) with the effect ma- 
trix E = XIa^i ^k\y-^k\y cau bc deduced from a past density matrix pp. The expression 
{A)^ = Tr(App) holds if we identify 

It is worth noting that Pp is not Hermitian and even if A is Hermitian, Tr(App) may 
have both real and imaginary parts. This is a well-known property of weak measurements, 
and it does not require the readout of, non-physical, complex measurement results, since 
the real part of (A)^ refers to the (real) mean value of the a^^-operator of the meter, while 
its imaginary part is obtained by measuring the average (Ty-spin component of the meter. 
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These averages may, in turn, indicate mean values of the system observable that are very 
different from its spectrum of eigenvalues. But this is well understood as an interference 
effect, when a measurement outcome is conditioned on different pre- and post-selected state 
of a physical system. [5] 



3. Projective read-out measurements and the past quantum state 

Imagine now that we perform a projective read-out measurement of the system observable 
A using our meter. In this case Cl^ = Ila™ where the different measurement results are the 
eigenvalues of the observable A denoted am- Following Eq. (A8) the probability for observing 
the eigenvalue a conditional on the later measurement result y is 

p/ I N Tr(n^^po_fl^^E+) 
Pwy) = — 7 : : s- 

where we by the + and — signs emphasize, that is the effect matrix including measure- 
ments from immediately after the projective read-out measurement was performed until time 
T (here exemplified with a single measurement with result y), and po- is the usual quan- 
tum state conditioned on the measurements until immediately before the projective read-out 
measurement was performed. The expectation value of the projective measurement of the 
observable A is then 

E[A\y] = J2^mPiaM = ^<f-^-^^-P'-^^-^- 

Tr (^E™'na„,P0-na„,E4 

By inserting a resolution of the identity / = Ylim' -^a^/ this expression can be written in two 

ways 

Tr (ipo- T.m tiarr^E+tiaS) Tr (a tiar^PO-tia^^E, 

m\y] = -\ z ^ = ^7 z z 

By introducing the effect matrix which takes the unobserved projective measurement into 
account by the map, E^ = J2m na,„-E'+na,„ we can write this result 

E[i|y] = Tr(ipp_), (A22) 

defining the past density matrix as Pp_ = po-i?-/ Tr(po_-E'_) immediately prior to the 
projective measurement. 
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Alternatively, we get 

my] = ^^P^, (A23) 
by using the past density matrix pp+ = po+-E'+/ Tr(po+-E'+), with the unobserved measure- 
ment process modifying the state po+ = Zlm na^Po-Ha^. 

The projective measurement disturbs the system, and it must hence be taken into account 
in one of the components of the past quantum state: In Eq. (A22) it is included in the effect 
matrix whereas in Eq. (A23) it is included in the forward density matrix po+. The two 
resulting alternative forms for the expectation value of A are equivalent since A commutes 
with the effect of the projective measurement. 

While the general formula Eq. (A5) using the past quantum state H = (po, E) can be 
applied to yield the probabilities for any past measurement outcome, it is interesting that the 
formalism may be brought closer to usual mean value expressions by use of the appropriately 
defined past density matrix. 



4. Differential equations for homodyne and counting measurements 



A quantum system subject to homodyne or heterodyne detection satisfies an Ito stochastic 
differential equation of the form given in Eq. (3). As discussed previously such a measure- 
ment scenario fits into the present formulation by using the measurement operator for the 
time interval from t to t + dt is given by Eq. (A2) if we assume 100% efficiency and no 

unobserved channels, i.e. no dissipation effects. The adjoint update Eq. (A12) is then 

1 



dEf = E-, 



t-dt 



Et 



H,Et 



{c^c,Et} +c^Etc 



dt + [c^Et + Etc] dYt 



t-dt- 



(A24) 



where we have chosen a normalization of the effect matrix E such that the front factor 
(2ndt)~^^'^ exp^—dY"^ / Adt) is discarded and E(T) = I where T is the final time of observa- 
tion. 

By including dissipation effects and limited detector efficiency we obtain Eq. (4). 
The conditional time evolution of a quantum system state subject to discrete counting 
signals in N channels can be described by the infinitesimal operators 



Mr, 



i — iHdt — -Ll^Lmdt 



LmV dt 



m=l 

foT 1 < m < N 



(A25) 



10 



where are Lindblad operators describing quantum jumps associated with the emission 
of quanta by the system into the environment. Mq yields the measurement effect when no 
quantum (photon) is detected and indicates that a quantum is detected in environment 
channel number m. 

If only the first channel is detected we get the well-established quantum jump filtering 
equation [2] 



dpt 



N . ^ \ 1 

H, Pt] + 5^ ( LmptUn - 2 {^m^m, Pt} ) " " \l\Li, pt^ + i:i{L{LiPt) Pt 
m=2 ^ 



dt 



+ 



LiptL[ 



Pt 



dNt, (A26) 



where dNt = in all the intervals where no photon is detected, but dNt = 1 (and dt = 0) at 
the instants of time a photon is detected in channel 1. 
The adjoint update of the effect matrix is 



dEt = Et, 



-dt 



E, 



N ^ s 
l[H,E^+Y.[^l^^^^rn--{LlU^,EM^ 
m=2 ^ ^ 



dt 



+ 



LlEtLi-Et dNt. (A27) 



5. Time evolution of mean values and weak values 

For a quantum system subject to unit efficiency homodyne detection and no unobserved 
dissipation channels, the conventional mean value of a system observable (A) = Tr(Apt) 
changes with time according to the stochastic differential. 



d{A) 



-i Tr( 



pt 



)dt + Tr (^Acptc^ - ^ |i, c^cj pt^ dt 

+ (Tt{{Ac + c^A)pt) - Tr((c + c^)pt) Tr(ipi)) dWt, (A28) 



where dWt = dYt - Tr((c + &)pt)dt. 

We now address the similar change according to the past quantum state, i.e, the change 
of the weak value estimate {A)^ = Tr(y4pp). The differential of the un-normalized past 
density matrix is 



d{ptEt) = pt+dtEt+dt — ptEt = dptEt+dt — ptdEt+dt- 
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By inserting the expressions Eq. (A24) and Eq. (3) we get 



d{ptEt 



—I 



H, PtEt+dt 



dt + [c, ptc^ Et+dt] dt - ^ [c^c, PtEt+dt] dt + [c, ptEt+dt] dYf 

(A29) 



Note that TT{d{ptEt)) = as expected since Ti{ptEt) = Tr(pr) is constant. The differential 
of the weak value d (A)^ = dTilApp^t) = ^'^{AdlptEt)) / Ti{ptEt) thus becomes 



d{A)^ 



Tr(piEi) 



-ii:i{[A,H]ptEt+dt)dt +Ti 



A, c 



ptC^Et+dt 



PtE, 



t+dt 



dt 



Ti{[A,c]ptEt+dt)dYt . (A30) 



This differs from the change in the conventional mean value and, in particular, we observe 
the suppression of the noise term oc dYt for observables which commute with the measure- 
ment operator c. This suppression explains the smooth behavior of the black dashed curves 
in Figs. 2(a) and 2(b), while the conventional mean values (A) show fluctuations due to the 
Wiener noise term, dW , in Eq. (A28). 



B. RELATION TO CLASSICAL HIDDEN MARKOV MODELS 

The classical theory of hidden Markov models is very well established and an excellent in- 
troduction can be found in Ref. 3. Here, a hidden Markov model is a discrete-time stochastic 
process where a hidden system state evolves according to a Markov chain and observations 
of some output signal depending on the system state are performed. Let Xt be the system 
state at time t and the output signal at time theYt. The output signal Yt depends only on 
the system state at the same time and its probability distribution is therefore completely 
determined by P{Yt\Xt). Since the evolution of Xt follows a Markov chain the system dy- 
namics is completely determined by the transition probabilities P{Xt+i\Xt). It is a simple 
matter to generalize these ideas to the continuous time case (such as a system governed by 
a rate equation), but for simplicity we will consider only the discrete time case here and the 
times t are integers. 

The full joint probability distribution for measurements Yt and states for a process running 
from time t = to time t = T is then 

T-l T 

P(Xo, . . . , Xr, Fi, . . . Ft) = n PiXt+i\Xt) n P{Yt\Xt)P{X^), (B31) 

t=o t=i 
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where P{Xo) is the probabihty for the initial state Xq. The theory of hidden Markov 
models provides numerically efficient algorithms for calculating the following quantities: (1) 
the forward filtered state probability distribution P(Xj|Yi, . . . Ij) and (2) the smoothed state 
probability distribution P{Xt\Yi, . . . Yt) for all times t. 

The forward estimate is easily calculated by a standard recursive Bayesian procedure. 
Following the notation in [3] we define the vectors 

at{7) = P{Y,,...Yt,Xt = i) (B32) 
Pt(^) = PiYt+^,...Y^\Xt = ^). (B33) 

Using the at and /3rvectors we can calculate the filtered and smoothed distributions at time 
t by the following formulas 

P,A-,^.|r.,„r.)^j£iW_, (33,) 

P(x, = ,|n,...y„) = ^i(!WW _ ,B35) 

both of which are variations of Bayes' formula. It is not difficult to show that at and Pt 
satisfy the following recursion relations 

at+iii) = J2 PiYt+ilXt+i = i)P{Xt+i =i\Xt= j)at{j) (B36) 
j 

A(0 = Y,Piyt+i\Xt+i = j)P{Xt+i = j\Xt = ^)f3t+lU), (B37) 
j 

where /3t(0 — ^ «o(0 — P{-^o = 0- ^^e following, we show that our effect matrix 
is equivalent to the /3r vector and that the past quantum state is the natural quantum 
generalization of the hidden Markov model pair {at,(3t). In the case of non-disturbing 
measurements the hidden Markov model smoothed state (B35) is equivalent to both the 
past quantum state S and the past density matrix pp. This is consistent with the weak 
value assumption of no disturbance of the system due to the measurements since classical 
measurements may always be thought of as non-disturbing). 

Indeed, the above hidden Markov theory can be formulated using diagonal density matri- 
ces and updates of the form given in Eq. (Al). Let \i) be an orthogonal basis for a Hilbert 
space, where i denotes the same internal states as in the hidden Markov model. The Markov 
chain evolution P{Xt-^-i\Xt) is now given by the update 

C: p ^ ^ |j) (j| PiXt+i = j\Xt = t) {t\p\t) , (B38) 
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which is in fact an evolution of the type given in Eq. (Al) with Mij = ^JP{Xt+l = j\Xt = i) \j) {i 
The observation process is given by the update 

X: p ^ Y^PiYt = y\Xt = i) {i\p\i) \i) {i\ (B39) 

i 

followed by re-normalization as in Eq. (Al). 

The classical hidden Markov model is then reproduced by picking the initial state po = 
J2i P{Xo = i) \i) m and applying the two updates C and X in sequence. 

The (un-normalized) forward filtered state at is simply the (un-normalized) filtered quan- 
tum state pt which satisfies the recursion relation 

^ K) (^1 PiYt+i = y\Xt+i = ^)P{Xt^l = t\Xt = j) m\j) = Pt+i (B41) 

which for diagonal pt is exactly Eq. (B36). 

The effect matrix Ef is initially = I which is equivalent to the initial condition 
Prii) = 1- The effect matrix is propagated according to the adjoint update Eq. (A12) as 

Et+i A J2 \J) 01 P(Yt+i = y\Xt+^ = j) {m+i\j) (B42) 
j 

A (^1 ^(^^+1 = y\Xt+i = j)PiXt+, = j\Xt = t) {m+,\j) ^ E,. (B43) 

which is exactly the update formula for fit Eq. (B37). Note here that the X- update is 
unchanged, whereas the adjoint update for C is modified. 

The theory of hidden Markov models includes numerically efficient algorithms for re- 
estimating the parameters occurring in the model. The so-called Baum- Welch algorithm 
is a special case of the Expectation-Maximization algorithm. By using the fully smoothed 
estimate as encoded in the a- and /3-vectors, a simple formula for the re-estimated parame- 
ters exists, which leads to a more likely sequence of measurement results Yi, . . .Yt given the 
model. In this way a local maximum of the likelihood can be calculated by iterating param- 
eter re-estimation and the smoothing calculation. We believe that a similar technique can 
be applied to estimate unknown parameters in quantum processes using the past quantum 
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state. 
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